Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[enhance](mtmv)mtmv date trunc support hour #37678

Merged
merged 6 commits into from
Jul 19, 2024
Merged

[enhance](mtmv)mtmv date trunc support hour #37678

merged 6 commits into from
Jul 19, 2024

Conversation

zddr
Copy link
Contributor

@zddr zddr commented Jul 11, 2024

before support:year", "month", "day"

now add:hour

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Jul 11, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39701 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f7e8eca3a699a8bc7ec81a5c16e13cbbcc2b508f, data reload: false

------ Round 1 ----------------------------------
q1	17633	4338	4275	4275
q2	2008	197	190	190
q3	10436	1197	1039	1039
q4	10192	807	769	769
q5	7543	2649	2649	2649
q6	218	137	134	134
q7	965	603	612	603
q8	9217	2051	2066	2051
q9	8697	6563	6521	6521
q10	8865	3728	3745	3728
q11	449	240	244	240
q12	466	229	226	226
q13	17766	2999	2964	2964
q14	269	246	233	233
q15	528	497	476	476
q16	525	375	383	375
q17	968	626	710	626
q18	7986	7479	7403	7403
q19	7444	1445	1429	1429
q20	674	313	325	313
q21	4785	3125	3154	3125
q22	387	336	332	332
Total cold run time: 118021 ms
Total hot run time: 39701 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4380	4242	4231	4231
q2	374	272	267	267
q3	3024	2891	2895	2891
q4	2019	1661	1636	1636
q5	5666	5521	5462	5462
q6	229	139	134	134
q7	2192	1884	1844	1844
q8	3273	3377	3412	3377
q9	8756	8784	8935	8784
q10	4010	3903	3759	3759
q11	587	510	496	496
q12	829	666	627	627
q13	16122	3206	3197	3197
q14	315	301	277	277
q15	537	487	475	475
q16	479	442	437	437
q17	1844	1550	1496	1496
q18	7935	8009	7970	7970
q19	3583	1524	1735	1524
q20	2141	1854	1848	1848
q21	5134	4856	4729	4729
q22	637	553	582	553
Total cold run time: 74066 ms
Total hot run time: 56014 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 175353 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f7e8eca3a699a8bc7ec81a5c16e13cbbcc2b508f, data reload: false

query1	912	369	370	369
query2	6451	2444	2341	2341
query3	6635	210	221	210
query4	28350	17771	17587	17587
query5	3737	481	482	481
query6	248	175	166	166
query7	4586	298	301	298
query8	321	301	288	288
query9	8612	2467	2473	2467
query10	447	293	290	290
query11	10678	10108	10024	10024
query12	113	97	83	83
query13	1640	377	373	373
query14	10197	7887	7722	7722
query15	242	180	192	180
query16	7772	336	321	321
query17	1761	564	542	542
query18	2010	289	287	287
query19	208	156	157	156
query20	90	83	84	83
query21	211	125	125	125
query22	4337	4347	4088	4088
query23	33978	33599	33520	33520
query24	10674	2868	2901	2868
query25	591	445	426	426
query26	705	157	155	155
query27	2173	288	300	288
query28	5861	2174	2167	2167
query29	968	667	619	619
query30	248	153	151	151
query31	958	739	743	739
query32	112	58	55	55
query33	655	309	294	294
query34	878	517	498	498
query35	691	587	601	587
query36	1114	985	1001	985
query37	145	80	86	80
query38	2947	2790	2803	2790
query39	873	860	819	819
query40	212	121	119	119
query41	54	50	51	50
query42	116	103	103	103
query43	616	590	579	579
query44	1090	719	718	718
query45	200	171	166	166
query46	1078	739	760	739
query47	1860	1754	1760	1754
query48	387	291	298	291
query49	834	411	425	411
query50	780	401	396	396
query51	6832	6807	6832	6807
query52	107	92	98	92
query53	357	292	299	292
query54	875	453	450	450
query55	75	75	73	73
query56	286	263	277	263
query57	1166	1029	1058	1029
query58	247	268	281	268
query59	3354	3382	3198	3198
query60	299	280	274	274
query61	98	95	95	95
query62	795	642	640	640
query63	331	292	300	292
query64	9107	2170	1676	1676
query65	3231	3094	3084	3084
query66	707	336	332	332
query67	15607	15113	14993	14993
query68	4587	542	535	535
query69	562	408	346	346
query70	1118	1146	1076	1076
query71	405	285	323	285
query72	7910	5466	5350	5350
query73	734	332	337	332
query74	5847	5503	5489	5489
query75	3379	2672	2685	2672
query76	2640	1011	982	982
query77	654	299	301	299
query78	9607	8951	9198	8951
query79	2155	518	529	518
query80	1810	479	480	479
query81	605	217	219	217
query82	688	137	135	135
query83	339	172	185	172
query84	269	91	100	91
query85	1625	312	312	312
query86	446	337	320	320
query87	3320	3126	3082	3082
query88	3854	2468	2489	2468
query89	545	389	395	389
query90	1869	197	200	197
query91	136	106	109	106
query92	62	51	53	51
query93	2275	511	505	505
query94	1219	220	223	220
query95	409	334	330	330
query96	617	276	271	271
query97	3211	3015	3049	3015
query98	218	200	198	198
query99	1575	1254	1265	1254
Total cold run time: 278520 ms
Total hot run time: 175353 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.71 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f7e8eca3a699a8bc7ec81a5c16e13cbbcc2b508f, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.07	0.06
query5	0.51	0.46	0.49
query6	1.15	0.73	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.55	0.49	0.50
query10	0.56	0.55	0.55
query11	0.15	0.11	0.11
query12	0.14	0.12	0.12
query13	0.58	0.58	0.59
query14	0.77	0.78	0.82
query15	0.86	0.81	0.82
query16	0.38	0.36	0.37
query17	0.97	0.96	1.00
query18	0.23	0.22	0.22
query19	1.85	1.72	1.76
query20	0.01	0.02	0.01
query21	15.41	0.74	0.64
query22	4.09	7.11	2.05
query23	18.25	1.37	1.24
query24	2.07	0.26	0.23
query25	0.16	0.08	0.08
query26	0.30	0.22	0.21
query27	0.46	0.23	0.24
query28	13.25	1.02	1.00
query29	12.65	3.34	3.29
query30	0.25	0.06	0.06
query31	2.87	0.38	0.40
query32	3.29	0.48	0.47
query33	2.88	2.93	2.92
query34	16.96	4.33	4.34
query35	4.41	4.41	4.46
query36	0.66	0.47	0.49
query37	0.18	0.16	0.16
query38	0.16	0.15	0.14
query39	0.04	0.04	0.04
query40	0.15	0.12	0.12
query41	0.09	0.05	0.05
query42	0.05	0.04	0.04
query43	0.05	0.03	0.04
Total cold run time: 109.47 s
Total hot run time: 30.71 s

@zddr
Copy link
Contributor Author

zddr commented Jul 12, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40011 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5f3b0ecb012de0c24473bd633f548260743ec453, data reload: false

------ Round 1 ----------------------------------
q1	17600	4468	4324	4324
q2	2017	191	187	187
q3	10457	1266	1152	1152
q4	10184	772	747	747
q5	7523	2699	2597	2597
q6	226	140	139	139
q7	964	608	601	601
q8	9213	2104	2060	2060
q9	8862	6549	6599	6549
q10	8745	3804	3785	3785
q11	465	249	233	233
q12	502	229	226	226
q13	17748	2945	2964	2945
q14	289	234	232	232
q15	522	484	475	475
q16	492	388	367	367
q17	970	684	770	684
q18	7974	7555	7343	7343
q19	6301	1538	1492	1492
q20	677	341	327	327
q21	5014	3208	3283	3208
q22	386	343	338	338
Total cold run time: 117131 ms
Total hot run time: 40011 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4444	4285	4292	4285
q2	364	279	264	264
q3	2985	2946	2942	2942
q4	2020	1648	1707	1648
q5	5625	5524	5487	5487
q6	242	135	132	132
q7	2227	1864	1838	1838
q8	3292	3432	3451	3432
q9	8769	8774	8846	8774
q10	4343	3920	3766	3766
q11	569	517	517	517
q12	872	645	646	645
q13	16100	3173	3146	3146
q14	336	290	287	287
q15	536	502	470	470
q16	507	426	420	420
q17	1829	1547	1535	1535
q18	8066	7969	7780	7780
q19	1817	1678	1753	1678
q20	2150	1862	1886	1862
q21	10660	4898	4733	4733
q22	663	545	575	545
Total cold run time: 78416 ms
Total hot run time: 56186 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174174 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5f3b0ecb012de0c24473bd633f548260743ec453, data reload: false

query1	922	375	365	365
query2	6437	2343	2344	2343
query3	6630	215	221	215
query4	27406	17445	17081	17081
query5	3628	491	487	487
query6	266	170	174	170
query7	4583	293	286	286
query8	331	307	298	298
query9	8700	2502	2454	2454
query10	437	284	274	274
query11	11605	9920	10127	9920
query12	121	88	84	84
query13	1648	377	382	377
query14	10127	7569	7324	7324
query15	250	191	189	189
query16	7705	336	347	336
query17	1312	557	543	543
query18	1957	288	284	284
query19	201	156	152	152
query20	90	84	83	83
query21	208	131	125	125
query22	4552	4040	4074	4040
query23	33948	33329	33557	33329
query24	11369	2983	2972	2972
query25	648	441	459	441
query26	937	159	157	157
query27	2303	287	287	287
query28	6760	2213	2193	2193
query29	922	650	666	650
query30	260	151	157	151
query31	986	797	740	740
query32	105	55	60	55
query33	783	309	335	309
query34	928	495	506	495
query35	719	585	604	585
query36	1135	1003	976	976
query37	153	91	90	90
query38	2976	2824	2888	2824
query39	912	820	816	816
query40	205	123	121	121
query41	56	52	54	52
query42	119	105	104	104
query43	593	552	545	545
query44	1207	737	836	737
query45	198	167	166	166
query46	1093	760	738	738
query47	1876	1765	1785	1765
query48	377	303	306	303
query49	846	410	425	410
query50	769	396	399	396
query51	6748	6744	6852	6744
query52	104	91	93	91
query53	357	288	286	286
query54	891	467	459	459
query55	74	75	77	75
query56	294	267	264	264
query57	1118	1011	1051	1011
query58	253	249	253	249
query59	3287	3130	3049	3049
query60	299	282	279	279
query61	100	99	101	99
query62	788	649	634	634
query63	320	293	289	289
query64	9365	2259	1667	1667
query65	3195	3075	3087	3075
query66	748	324	324	324
query67	15652	15086	14838	14838
query68	6199	572	567	567
query69	739	824	356	356
query70	1245	1170	1082	1082
query71	525	279	294	279
query72	8926	5379	5849	5379
query73	808	335	331	331
query74	5894	5555	5586	5555
query75	5096	2729	2666	2666
query76	4751	964	887	887
query77	781	304	335	304
query78	10611	9043	10146	9043
query79	7426	542	549	542
query80	2299	538	490	490
query81	589	221	226	221
query82	652	136	136	136
query83	285	172	168	168
query84	279	96	92	92
query85	1340	319	308	308
query86	456	314	304	304
query87	3258	3145	3098	3098
query88	4658	2484	2506	2484
query89	487	406	398	398
query90	1942	200	243	200
query91	138	107	110	107
query92	66	51	52	51
query93	4479	530	524	524
query94	1160	221	221	221
query95	420	327	329	327
query96	615	276	286	276
query97	3215	3063	3044	3044
query98	243	204	190	190
query99	1550	1290	1274	1274
Total cold run time: 297024 ms
Total hot run time: 174174 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.79 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5f3b0ecb012de0c24473bd633f548260743ec453, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.23	0.05	0.05
query4	1.68	0.07	0.08
query5	0.51	0.48	0.49
query6	1.14	0.73	0.72
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.55	0.49	0.48
query10	0.55	0.54	0.54
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.59	0.58	0.59
query14	0.75	0.78	0.82
query15	0.84	0.81	0.82
query16	0.36	0.36	0.37
query17	1.02	1.02	1.03
query18	0.23	0.22	0.22
query19	1.94	1.76	1.75
query20	0.02	0.01	0.01
query21	15.46	0.74	0.65
query22	5.32	6.08	1.89
query23	18.29	1.36	1.38
query24	2.14	0.22	0.22
query25	0.15	0.08	0.08
query26	0.30	0.21	0.22
query27	0.45	0.24	0.23
query28	13.32	1.01	1.00
query29	12.63	3.29	3.28
query30	0.25	0.06	0.06
query31	2.87	0.38	0.40
query32	3.27	0.48	0.48
query33	2.90	2.92	2.94
query34	17.01	4.43	4.38
query35	4.40	4.41	4.46
query36	0.65	0.48	0.45
query37	0.19	0.17	0.15
query38	0.16	0.14	0.14
query39	0.04	0.03	0.04
query40	0.16	0.12	0.13
query41	0.09	0.05	0.05
query42	0.06	0.05	0.04
query43	0.04	0.05	0.04
Total cold run time: 111.05 s
Total hot run time: 30.79 s

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@zddr
Copy link
Contributor Author

zddr commented Jul 19, 2024

run cloud_p0

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 19, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@morrySnow
Copy link
Contributor

run cloud_p0

1 similar comment
@zddr
Copy link
Contributor Author

zddr commented Jul 19, 2024

run cloud_p0

@morrySnow morrySnow merged commit 76c6d17 into apache:master Jul 19, 2024
28 of 29 checks passed
dataroaring pushed a commit that referenced this pull request Jul 22, 2024
@zddr @dataroaring
[enhance](mtmv)mtmv date trunc support hour (#37678)
cf689d7 
before support:year", "month", "day"

now add:hour
zddr added a commit to zddr/incubator-doris that referenced this pull request Jul 26, 2024
@zddr
[enhance](mtmv)mtmv date trunc support hour (apache#37678)
a066e0e 
before support:year", "month", "day"

now add:hour
@zddr zddr mentioned this pull request Jul 26, 2024
Merged
yiguolei pushed a commit that referenced this pull request Jul 31, 2024
@zddr
[enhance](mtmv)mtmv date trunc support hour (#37678) (#38422)
319933d 
pick: #37678
@gavinchou gavinchou mentioned this pull request Aug 19, 2024
Open
@yiguolei yiguolei mentioned this pull request Sep 5, 2024
Open
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@morrySnow morrySnow morrySnow approved these changes

@seawinde seawinde seawinde approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.1-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@zddr @doris-robot @morrySnow @seawinde @yiguolei @dataroaring